AURORA MARKET RESEARCH
1 Intoduction
Hello, I’m Joseph from Morocco.
Inspired by Hans Rosling’s TED Talk, I taught myself data scraping, analysis, and visualization.
This non-academic approach has given me a unique perspective, as reflected in my projects—though it also means I may require a thorough onboarding process to align with team standards.
I’m open to starting as an intern, either full-time or part-time. Regarding time zones, I’m in UTC+1, but I’m flexible and can adjust my schedule to accommodate the team’s needs.
Feel free to reach me at joseph.ergo@proton.me, and to visit my website for more projects josephelhaddad.github.io.
This custom report, generated from processing 1.4 TB of public data locally, aims to explore the workforce dynamics of a company—up to 2020.
Essentially, I am doing research on a company that does research.
2 About the project
The project came to life after realizing that web scraping doesn’t allow deep-level filtering—without consuming too much time.The irony is, this project itself took me about a month, but the final RDB contains more data than I could ever scrape.
The raw data was 1.4 TB in size and holds information previously scraped.
Processing was done on my local machine using Python, Polars, and DuckDB, following this workflow:
- Processed raw data into structured Parquet files using Polars.
- Transformed each Parquet file into mini RDBs using Polars.
- Merged all mini RDBs into one using DuckDB.
- Analyzed and filtered data to fit the current project.
3 EDA
3.1 market research indestry’s yearly new recruit count
3.2 aurora market research’s workforce status over the years
4 Workforce sample
4.1 Adrian Ward
Job title: Research executive
Associated: False
Socials: https://linkedin.com/in/adrian-ward-81b2768 | https://linkedin.com/in/adrianward2017
4.1.1 Adrian Ward’s working period at aurora market research
4.1.2 Gantt plot of Adrian Ward’s experience
4.2 Ben Cookman
Job title: Senior research executive
Associated: False
Socials: https://linkedin.com/in/ben-cookman-0b6a0423 | https://facebook.com/ben.cookman
4.2.1 Ben Cookman’s working period at aurora market research
4.2.2 Gantt plot of Ben Cookman’s experience
4.3 Catherine King
Job title: Panel manager
Associated: True
Socials: https://linkedin.com/in/catherine-king-838ba336
4.3.1 Catherine King’s working period at aurora market research
4.3.2 Gantt plot of Catherine King’s experience
4.4 Dan Brilot
Job title: Head of client and panel services
Associated: False
Socials: https://linkedin.com/in/danbrilot | https://twitter.com/brilotd | https://linkedin.com/in/dan-brilot-73bb493
4.4.1 Dan Brilot’s working period at aurora market research
4.4.2 Gantt plot of Dan Brilot’s experience
4.5 Emma Norman
Job title: Panel manager
Associated: False
Socials: https://linkedin.com/in/emma-norman-b1a983a
4.5.1 Emma Norman’s working period at aurora market research
4.5.2 Gantt plot of Emma Norman’s experience
4.6 Judy Ovens
Job title: Market research consultant
Associated: True
Socials: https://linkedin.com/in/judy-ovens-b68a34172
4.6.1 Judy Ovens’s working period at aurora market research
4.6.2 Gantt plot of Judy Ovens’s experience
4.7 Justin Alderson
Job title: Owner
Associated: True
Socials: https://linkedin.com/in/justin-alderson-4b010b2
4.7.1 Justin Alderson’s working period at aurora market research
4.7.2 Gantt plot of Justin Alderson’s experience
4.8 Kelly Fitzgerald
Job title: Manager
Associated: True
Socials: https://linkedin.com/in/kelly-fitzgerald-58bb932
4.8.1 Kelly Fitzgerald’s working period at aurora market research
4.8.2 Gantt plot of Kelly Fitzgerald’s experience
4.9 Kiertan Rourke
Job title: Research manager
Associated: False
Socials: https://linkedin.com/in/kiertan-rourke-89a74079
4.9.1 Kiertan Rourke’s working period at aurora market research
4.9.2 Gantt plot of Kiertan Rourke’s experience
4.10 Louise Bonnici
Job title: Associate director
Associated: True
Socials: https://linkedin.com/in/louiseainslie
4.10.1 Louise Bonnici’s working period at aurora market research
4.10.2 Gantt plot of Louise Bonnici’s experience
4.11 Lukas Revzin
Job title: Research executive
Associated: False
Socials: https://linkedin.com/in/lukas-revzin-00318242
4.11.1 Lukas Revzin’s working period at aurora market research
4.11.2 Gantt plot of Lukas Revzin’s experience
4.12 Melissa Martin
Job title: Panel executive
Associated: False
Socials: https://linkedin.com/in/melissa-martin-69008b94
4.12.1 Melissa Martin’s working period at aurora market research
4.12.2 Gantt plot of Melissa Martin’s experience
4.13 Nora Butkute
Job title: Assistant
Associated: True
Socials: https://linkedin.com/in/nora-butkute-42708283
4.13.1 Nora Butkute’s working period at aurora market research
4.13.2 Gantt plot of Nora Butkute’s experience
4.14 Nora Butkute
Job title: Assistant
Associated: False
Socials: https://linkedin.com/in/nora-butkute-707080109
4.14.1 Nora Butkute’s working period at aurora market research
4.14.2 Gantt plot of Nora Butkute’s experience
4.15 Peter Hershel-Jones
Job title: Sales manager
Associated: False
Socials: https://linkedin.com/in/peter-hershel-jones-a3a8872
4.15.1 Peter Hershel-Jones’s working period at aurora market research
4.15.2 Gantt plot of Peter Hershel-Jones’s experience
4.16 Steven Jones
Job title: Panel manager
Associated: False
Socials: https://linkedin.com/in/steven-jones-7516a438